Multi-agent deep reinforcement learning based Predictive Maintenance on parallel machines

نویسندگان

چکیده

In the context of Industry 4.0, companies understand advantages performing Predictive Maintenance (PdM). However, when moving towards PdM, several considerations must be carefully examined. First, they need to have a sufficient number production machines and relative fault data generate maintenance predictions. Second, adopt right approach, which, ideally, should self-adapt machinery, priorities organization, technician skills, but also able deal with uncertainty. Reinforcement learning (RL) is envisioned as key technique in this regard due its inherent ability learn by interacting through trials errors, very few RL-based frameworks been proposed so far literature, or are limited respects. This paper proposes new multi-agent approach that learns policy performed technicians, under uncertainty multiple machine failures. comprises RL agents partially observe state each coordinate decision-making scheduling, resulting dynamic assignment tasks technicians (with different skills) over set machines. Experimental evaluation shows our outperforms traditional policies (incl., corrective preventive ones) terms failure prevention downtime, improving ?75% overall performance.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Multi-Agent Deep Reinforcement Learning

This work introduces a novel approach for solving reinforcement learning problems in multi-agent settings. We propose a state reformulation of multi-agent problems in R that allows the system state to be represented in an image-like fashion. We then apply deep reinforcement learning techniques with a convolution neural network as the Q-value function approximator to learn distributed multi-agen...

متن کامل

Lenient Multi-Agent Deep Reinforcement Learning

Much of the success of single agent deep reinforcement learning (DRL) in recent years can be attributed to the use of experience replay memories (ERM), which allow Deep Q-Networks (DQNs) to be trained efficiently through sampling stored state transitions. However, care is required when using ERMs for multi-agent deep reinforcement learning (MA-DRL), as stored transitions can become outdated bec...

متن کامل

Parallel Fault Tolerant Multi-Agent Reinforcement Learning

Reinforcement learning is a powerful tool for training an agent in a sequential decision based environment and has been successful in many simulated [6] as well as practical [5] domains. In this paper we investigate methods of strengthening the rate of convergence of a single agent RL learner by sharing observations with other independent agents. In contrast to multi-agent reinforcement methods...

متن کامل

Operation Scheduling of MGs Based on Deep Reinforcement Learning Algorithm

: In this paper, the operation scheduling of Microgrids (MGs), including Distributed Energy Resources (DERs) and Energy Storage Systems (ESSs), is proposed using a Deep Reinforcement Learning (DRL) based approach. Due to the dynamic characteristic of the problem, it firstly is formulated as a Markov Decision Process (MDP). Next, Deep Deterministic Policy Gradient (DDPG) algorithm is presented t...

متن کامل

Learning to Communicate with Deep Multi-Agent Reinforcement Learning

We consider the problem of multiple agents sensing and acting in environments with the goal of maximising their shared utility. In these environments, agents must learn communication protocols in order to share information that is needed to solve the tasks. By embracing deep neural networks, we are able to demonstrate endto-end learning of protocols in complex environments inspired by communica...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Robotics and Computer-integrated Manufacturing

سال: 2022

ISSN: ['1879-2537', '0736-5845']

DOI: https://doi.org/10.1016/j.rcim.2022.102406